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Abstract 

This paper provides a positive answer to the question of existence 
of regularities of so called random in a broad sense mass phenomena, 
using the terminology of A. N. Kolmogorov [1]. It turns out that 
some closed in weak-* topology family of finitely-additive probabili- 
ties is the statistical regularity of any such phenomenon. If the mass 
phenomenon is stochastic, then this family degenerates into a usual 
countably-additive probability measure. The paper provides defini- 
tions, the formulation and the proof of the theorem of existence of 
statistical regularities, as well as the examples of their application 
Key words Families of probability distributions, randomness, statis- 
tical regularity, sampling net 



1 Introduction 

The interest in studying the properties of mass random phenomena (MRP) 
is not new. So in [3, Q] the authors pointed out the difficulties arising in the 
process of modeling of the social MRP. In particular, in |4| one reads:"Some 
contemporary theoreticians consider the law of large numbers as a simple tau- 
tology, since they think that the probability could be denned as frequency for 
a very large number of trials. If for a very big number of trials this frequency 



* victor . ivanenko .l@gmail.com 

^Department of mathematical modeling of economical systems, Kyiv Polytechnical In- 
stitute, 57, Prospekt Peremogy, Kyiv 03056, Ukraine, 



1 



does not tend to a limit, but fluctuates more or less between different limits, 
one needs to affirm that probability p does not remain constant and changes 
in the process of trials. This concerns, for example, human mortality rate 
in the course of centuries, since the progress of medicine and hygiene leads 
to the increase of life duration." The problem of revealing of the regularities 
of MRP becomes more and more important, especially in relation to the in- 



24, 



25 



, that 



stability of financial markets and other economic objects 
makes forecasting in this area very unreliable. 

It is relevant to mention here the following remark by A.N. Kolmogorov 
[l|: "Speaking of randomness in the ordinary sense of this word, we mean 
those phenomena in which we do not find regularities allowing us to predict 
their behavior. Generally speaking, there are no reasons to assume that ran- 
dom in this sense phenomena are subject to some probabilistic laws. Hence, 
it is necessary to distinguish between randomness in this broad sense and 
stochastic randomness (which is the subject of probability theory)". 

However, what do the words "do not find regularities allowing us to pre- 
dict their behavior" mean? Hardly these words should be understood in the 
sense that such regularities do not exist at all. More likely, these words point 
out to the problem of finding statistical regularities of random in a broad sens 
mass phenomena (RBSMP), that is the regularities of asymptotic behavior 
of different average values that characterize these phenomena. It can be fre- 
quencies of hitting in given subsets, arithmetic averages of some functionals, 
and so on. Recall that MRP are called statistically stable or stochastic, if 
with the increase of the number of "trials" all these averages tend to limits 
(and if some other conditions are verified as well, see details in Unlike 
this, it is natural to consider as RBSMP those MRP, whose behavior is stud- 
ied to within statistical regularities. In other words, this definition combines 
in RBSMP stochastic as well as nonstochastic random phenomena. 



1 Remark that the term "nonstochastic" appeared in in the context of Kolmogorov's 
complexity, meaning " more complex than stochastic" . In this paper the meaning of this 
term is " more random than stochastic" . 
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In [5j the question was risen whether the MRP (or, as we say now, RB- 
SMP) posses the properties that are necessary in order to apply the prob- 
ability theory to their description? In other words 2j, this is the question 
of "empirical origins of the notion of probability". □ The positive answer 
to this question, namely, the theorem of existence of statistical regularities 
in the form of families of probability distributions, and their significance to 
decision theory, constitute the content of this paper. 

2 Theorem of existence of statistical 
regularities 

An ordinary sequence is the simplest mathematical model of a mass phe- 
nomenon. In order to construct, on the basis of a sequence, a model of a 
random phenomenon, it is necessary to identify sequences that have identical 
statistical properties. 

Definition 1. Let X be an arbitrary set. Two sequences x^ and x^ of 
elements of the set X are called statistically equivalent (S -equivalent) if and 
only if for any natural number m and any bounded mapping 7 G (X — > M. m ) 
the set of limit points of the sequence 



n 

{#;neN},# = i]C 7 (xf> 



n . 
i=i 

does not depend on k G {1,2}. 

The class of ^-equivalence of the sequence x G X N will be denoted as 
S(x). Our nearest goal is to find the invariant of the relation of S'-equivalence. 
Introduce several notions. 

Let M be a Banach space of bounded real functions, defined on the set 
X, M* be the dual space of the space M, and r - is a weak-* topology in 



2 See also @. 
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M*. Let, further, PF(X) be the subspace of the topological space (M*,r) 
defined by the formula 

PF(X) = {peM*: p(f) > if / > 0,p(l x ) = 1} , 

where 1a( - ) is the characteristic function of the set A. 

In what follows, instead of p{1a) we shall often write p(A) identifying, by 
the same token, the elements of the set PF(X) with the finitely additive and 
normed measures on 2 X . Obviously, p(f) in this case is simply the integral 
p(f) = J f(x)p(dx), defined naturally due to boundedness of function /. 

Associate to an arbitrary sequence x = {x n ; n G N} G X N the sequence 
of measures from PF(X) defined as 

1 n 

n} ,p^\a) = -Y^Uix^A c x. 

i=i 

Due to compactness of the space PF(X) (as of a bounded closed set in 
(M*,r)), the sequence jpi"^(-);n G n| will have a non-empty closed set of 
limit points, which we denote as P% and call the regularity of this sequence. 
Therefore introduce the following definition. 

Definition 2. Any non-empty closed subset of the space PF(X) is called 
a regularity on X . Denote the set of all regularities on X as P(X) and 
associate to any sequence x G X N its regularity P^. Finally, for m G N, 
7 = ( 7l , 72 , . . . ,7 m ) G (X ->• R m ) and P G P(X) ; the symbol P( 7 ) denotes 
tee se£ 

{(ri,r 2 , . . . ,r m ) G lR m : 3p G P,r, = p(ji),Vi G l,m} ; 

and, m particular, p(j) = (^(71)^(72), • • • ,p(lm)) for p G PF(X). 

Consider the following proposition. 

Proposition 1. The mapping x ^ P^ is the invariant of the relation of 
S -equivalence on X n . 
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This statement will be proved below in a more general form. So far, 
however, let us agree to call the classes of S'-equivalence of sequences the 
simplest random phenomena, and their regularities - statistical regularities 
of the corresponding phenomena. Any sequence x G X N is considered as a 
realization of a simplest random phenomenon S(x). 

Connection of the notions introduced above with the probabilistic notions 
follows directly from the enforced law of large numbers. 

Proposition 2. Let X be a finite set, fi - a probability distribution on X , 
and £ = {£ n ; n G N} - a sequence of independent (in the usual sense) random 
elements, taking values in X with distribution fi. Then with probability 1 the 
sequence x of the values of the sequence £ will be a realization of the simplest 
random phenomenon S(x) with statistical regularity P T = {fi}, i.e. consisting 
of the single distribution fi. 

However, when the set X is infinite everything becomes considerably 
more difficult. In this case, the capabilities of sequences, generally speaking, 
are insufficient in order to guarantee that the frequencies of hitting in all 
measurable sets would tend to their limits simultaneously. Moreover, it is 
easy to see that the regularities of sequences, since they are concentrated 
only on a countable subset of the set X, constitute only a small part of the 
set of all regularities on X. This seems to reflect the fact that sequences 
constitute only a small part of all mass phenomena. A more general notion 
of sampling net is, as we shall see further, already sufficient for our goals. 

Definition 3. A sampling net (s.n.) in X is any net (p = {<^\, A G A, >} 
taking values in the sampling space 

oo 

x°°=|Jx n , r = ix-xi . 

n=l n 

Moreover, if A G A,ip\ G X n then we denote n = n\, ip\ = ((fi\i, y?A2, • • • , ¥\n x ) 
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and associate to this X the measure p\p G PF[X) defined as 

The set P v of limit points of the net p v = {p^, A G A, >} will be called the 
regularity of the s.n. if. The class of all s.n. in X will be denoted as $(X). 

Extend now the relation of ^-equivalence on the whole $(X). 

Definition 4. Sampling nets ip( k ' G <&(X),k = 1,2 are considered as S- 
equivalent if and only if for any m G N and any bounded mapping 7 G (X — > 
R m ) the set of limit points of the net of averages 

{v?'.A6A,>}, s f = _Lf; 7 (^)) (i) 

i=l 

does not depend on k G {1,2}. 

We can now formulate the main theorem in the following way. 

Theorem 1. (i) For any s.n. (p G <&{X), any m G N and any bounded 
mapping 7 G (X — >■ IR m ), the set of limit points of the net (Qp can be 
written as P^j). 

(ii) The mapping ip \-t P v , defined on $(X), is the invariant of the relation 
of S -equivalence. 

(Hi) This mapping is a mapping on the whole set P(X), i.e. the set <&(X)/S 
of classes of S-equivalence and the set P(X) of regularities are put by 
this mapping into one-to-one correspondence. 

This theorem justifies the following definition. 

Definition 5. Any class of S-equivalence of sampling nets in X is called 
random in a broad sense mass phenomenon in X. The regularity P^ is called 
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the statistical regularity of the random phenomenon S(<p). Any s.n. <p' G 



S(<p) is called a realization of the random phenomenon S(<p). The random 
phenomenon, having statistical regularity P, is called fi-stochastic if and only 
if there exists a non-trivial a-algebra A C 2 X , on which fi is a a-additive 
probability, and p(A) = fi(A) for all p G P, A G A. 



Denote the set of limit points of an arbitrary net g = {g a ,a G A, ^} with 
values in X as LIM(g) or LIM {g a , a G A, )>=}. Denote the set of bounded 
mappings from X into M. m as M m . We need to establish the three following 
facts: 

(i) The relation 



is true for all m G N, 7 G M m , <p G ${X). 

(ii) If P11P2 G F(X),P 1 7^ P 2 , then there exist such m G N and such 
7 g M m , that Pi (7) (7). 

{in) For any regularity P G P(X) there exist such s.d. if G that 



Begin with the proof of the proposition (i). Let r G LIM(y), where ?/ = 
{yx, A G A, Then there exists a subnet of the net y converging to r, i.e. 
there exists (see [8|) a directed set (A, )p) and a function / : A — > A such 
that the net y = y o / converges to r, and, in addition, for any A G A there 
exists such a\ G A that /(a) ^ A for all a )p a\. 



3 The proof 



LIM{y x ,Xe A,^} = P^( 7 ), 



where 
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Consider now the net of measures p^ = p^of, where p v = <.p}p , A G A, ^ j 
By virtue of compactness of the space (PP(X),r) this net has at least one 
limit point. Denote it as p and consider a subnet p v of the net p v , con- 
verging to Pq. Let it be p^ = p v o g = p v o / o g, g : B — > A. Then the 
net y = y o / o g, on the one hand, converges to r, and, on the other hand, 

= 3^\l)^ e B, so that 

r = limf^f (7) = p (7) e ^(t)- 

By the same token, it is proved that LIM(y) C P v (7). 

Conversely, if p £ P/J5 r = Po(7)> then there exists a subnet p v = 
{p®, «ei,^}of the net p^, converging to po- But in this case lim a p^(7j) = 
Po(7i) for all % G l,m. It means that linio, p^ (7) = ^0(7)- And, since 

(7) = 2/a f° r A = /(a), this proves (i). 

In order to prove (ii) assume that there exists pi G Pi \ P2. Since the set 
P2 is closed, there exists a vicinity of the point p\ that does not cross with 
P2 and it means that there exist such e > 0, 71, 72, . . . , 7 m G M that 



Vp 2 G P 2 ,3i G l,m, |pi(7i) -P2(ji)\ > e. 
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271 ] . Here we shall 



So that if 7 = (71,72, • • -,7m), then ^1(7) P 2 (7). 

The complete proof of (m) can be found in 
outline the main ideas of the proof. Let Q be the set of all such measures 
q G PF(X) that each one of them is concentrated on a finite set X q C X, 
and in addition all numbers q(x),x G X q are rational. One can show that 
the set Q is everywhere dense in (PF(X),t). 

Now, to an arbitrary regularity P G P(X) we put into correspondence 
the directed set (A, )p) such that 



A = R + x M°° x P, M + =]0, oo[, M°° = Q M m , M m = M x ■ ■ ■ x M 



m=l 
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and the relation (^=) is given by the formula 

(El, Til) 712, • • • ,7lni,Pl) > (£2,721,722, • • • ,72n 2 ,P2) <^> 
(ei < e 2 , {711,712, • • • ,7lnJ 2 {721,722, • • • ,72n 2 }), 

where no condition is imposed on pi and ^2- 

Finally, to any A = (e, 71,72, • • • , 7m, p) G A we put into correspondence 
some 



£QC\{p ePF(X) :Vz G I,m,|p(7i)-P(7i)| < e} • 



It is proven further that with any A G A one can associate simultaneously 
a sequence of points x[ , x 2 , • • • , x^ G X g satisfying the condition 



q x (A) = -f]l A (x[\ VACX 



i=l 



It remains to chose ip\ = (x[ , x 2 , ■ ■ ■ , Xnx) an d we obtain a s.n. 90 : A 1— > (fx 
that has the regularity P v — P '■ 

4 Applications in decision theory 

Statistical regularities of the general form find their application in decision 
theory Q, 0, 0, 0, 
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and its applications [30]. 
Considering decision problems, assume that we need to make a decision 
u from the set U of possible decisions, knowing that the result of making a 
decision depends on some uncontrolled parameter 9 from the set of possible 
values of this parameter and is described by the bounded real loss function 
L : x U — > EL If nothing is known about the behavior of the parameter, 
then we cannot, strictly speaking, exclude that scenario, where the value of 9 
is chosen in the worst possible for us way. In this case, the quality of decision 
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u is evaluated by means of the loss function 



L\(u) = sup L(9, u), u E U, 
see 

a so called "minmax" criterion. 

If it is known, that parameter 9 is stochastic with the given distribution 
/i, then, trying to minimize the average losses, one makes use of the Bayes 
criterion 



L* 2 (u) = J L(9,u)/i(d9), ueU. 



Suppose now that parameter 9 is random in a broad sense with the sta- 
tistical regularity P G P(O). Let us show that in this case it is natural to 
chose the criterion in the form of 

L* 3 (u) = sup / L{9,u)p{d9), u e U, (2) 
peP J 

Indeed, let r\ < L^{u) < r 2 . The following statement is straightforward 

Proposition 3. Let {ip\, A e A, ^} - be a sampling net in with the regu- 
larity P. Then for any Ai 6 A there is such A )p Ai that 

and, at the same time, there is such A 2 , that for all A )p A 2 there will be 

— ^H^Pxhu) < r 2 . 



In other words, L^(u) - is that natural border, that separates the average 
losses, that can happen for a given u for an arbitrary "large" A, from those 
average losses that are not "dangerous" to us, when A is sufficiently "large". 
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It is easy to see that L^(u) becomes L\(u), when P = PF(Q) (strictly 
nothing is known about 9, save the set where it takes values), and that it 
becomes L^u), when P = [i is stochastic regularity and function L(-,u) is 
measurable relatively to the corresponding a- algebra. 

The inverse result appears as somewhat surprising. It turns out that if one 
subordinates a criterion choice rule to some natural conditions of consistency 
with the triplet (9, U, L), then any rule, satisfying these conditions, leads to 
the criterion of the form (jSJ), where P - is some (not known beforehand) 
regularity on 0. In particular, this result justifies the heuristic definition of 
random in a road sense phenomena introduced above. Therefore, one can 



conclude that regularity on G is, in a certain sense, the most gen eral 
information about the behavior of 9. One can find details in 14, 2, 
27]. 



orm of 
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5 Concluding remarks 



There are several approaches to mode ling of the MRP. So, there is the al- 
gorithmic approach to randomness [9], 111] as well as the game-theoretic ap- 
proach to randomness in finance [19]. An alternative approach was studied 
in (l0|. where sequences were constructed only with the requirement of the 
so called IV independence. In mathematical finance diverse extensions of 
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22]. 



stochastic models have been popular 

At the same time, when modelling the possible properties of the RBSMP 
it is natural to consider families of probability distributions. In scientific lit- 
erature, the families of probability distributions appear more and more often. 
So, they were considered in game theory 0] in order to study non-additive set 
functions. In the so called subjective decision theory these families appear 



16] , where, similarily 



as consequence of the axioms of rational choice Ij| ll5|, 
to robust statistics 0, they were interpreted ^famines of a priori distri- 
butions. Families of probability distributions attract all the more attention 
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in statistical data analysis [26]j. 

It turns out that specifically families of probability distributions are nec- 
essary for the description of statistical (frequentist) regularities of a rather 
wide class of RBSMP. The theorem of existence of such statistical regularities 
was published earlier in somewhat different form 

HQ. 



3 1 am thankful to professor Vladimir Vovk who made me familiar with the works of 
professor Terrence Fine and, in particular, with this paper. 
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